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Report  No.  95-047  December  2,  1994 

MEMORANDUM  FOR  ASSISTANT  SECRETARY  OF  THE  AIR  FORCE 

P^INANCIAL  MANAGEMENT  AND  COMPTROLLER) 
DIRECTOR,  DEFENSE  LOGISTICS  AGENCY 

SUBJECT:  Audit  Report  on  Quality  Assurance  Practices  for  the  AN/FMQ-7  Optical 
Telescope  Procurement  (Project  No.  4CF-8009) 


Introduction 

We  are  providing  this  report  for  your  review.  We  performed  the  audit  in 
response  to  a  referral  from  the  DoD  Hotline  concerning  an  allegation  regarding 
improper  contract  qujdity  assurance  practices  by  the  Defense  Contract 
Management  Area  O^rations  Dallas,  Texas  (DCMAO  Dallas),  on  an  Air  Force 
contract  for  upgrading  the  Air  Force’s  solar  electro-optical  network  (SEON). 

The  complainant  alleged  that  DCMAO  Dallas  showed  favoritism  to  the 
contractor.  Electrospace  Systems,  Inc.  (Electrospace),  because  DCMAO  Dallas 
did  not  properly  and  completely  investigate  the  cause  of  a  product  deficiency. 
The  complainant  stated  that  the  alleged  favoritism  occurred  when 
DCMAO  Dallas  prepared  an  investigation  report  that  contained  only  the 
contractor's  response  to  a  product  quality  deficiency  report  (PQDR)  with  no 
Government  input.  The  complainant  further  stated  that  the  investigative  report 
was  full  of  erroneous  findings. 


Audit  Results 

We  did  not  substantiate  the  allegation  regarding  improper  contract  quality 
assurance  practices  at  DCMAO  Dallas.  We  found  no  evidence  that  the 
DCMAO  Dallas  showed  favoritism  to  Electrospace  in  the  PQDR  investigation. 
The  Category  I  PQDR  investigation  report  incorrectly  stated  that  the 
Government  conducted  a  concurrent  investigation  with  the  contractor. 
However,  we  concluded  that  the  inaccurate  statement  in  the  investigation  report 
had  no  bearing  on  the  remainder  of  the  investigative  report.  We  did  not 
determine  the  accuracy  of  the  contractor's  input  into  the  investigation  report. 

The  Air  Force  Operational  Test  and  Evaluation  Center  (AFOTEC)  prepared  a 
Category  I  PQDR  during  first-article  site  testing  in  Hawaii  of  the  upgrade  to  the 
AN/FMQ-7  optical  telescope  (the  optical  telescope).  As  a  result  of  the  testing, 
AFOTEC  identified  a  deficiency  in  the  software  used  in  the  upgraded  system. 
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AFOTEC  identified  the  deficiency  in  a  Category  I  PQDR  sent  to  DCMAO 
Dallas  for  investigative  support.  DCMAO  Dallas  prepared  an  investigative 
report  on  the  PQDR  but  only  included  the  Electrospace  position  on  the 
deficiency. 

DCMAO  Dallas  did  not  perform  a  complete  investigation  of  the  AFOTEC 
PQDR  because  the  optical  telescope  system  and  its  software  were  in  Hawaii 
with  the  telescope.  The  quality  assurance  specialists  in  Dallas,  Texas,  could  not 
review  the  software. 

DCMAO  Dallas  believed  that  the  PQDR  was  probably  invalid  because  the 
upgraded  system  had  not  passed  first-article  testing  and  was  not  Government- 
owned  property.  However,  the  urgency  of  a  Category  I  PQDR  caused 
DCMAO  Dallas  to  request  Electrospace's  immediate  response  to  the  PQDR  and 
to  prepare  an  investigative  report  containing  only  Electrospace's  response.  A 
Category  I  PQDR  refers  to  a  problem  that  can,  if  imcorrected,  cause  death, 
severe  injury,  or  severe  occupational  illness;  cause  major  loss  or  damage  to 
equipment  or  to  a  system;  or  directly  restrict  combat  or  operational  readiness. 

Air  Force  Technical  Manual  TO  00-35D-54,  "USAF  [United  States  Air  Force] 
Deficiency  Reporting  and  Investigating  System,"  April  15,  1991,  addresses 
deficiency  reporting  during  test  and  evaluation.  The  technic^  manual 
contributed  to  confusion  and  misunderstandings  between  the  various 
DoD  Components  that  were  involved  in  the  procurement  and  administration  of 
the  upgrade  for  Ae  optical  telescope.  The  technical  manual  does  not  distinguish 
between  reporting  deficiencies  on  items  that  are  Government-owned  and  items 
that  are  not  Government-owned.  The  technical  manual  instructs  that  PQDRs 
sent  across  DoD  Component  lines  be  handled  in  accordance  with  Joint 
Regulation,  Defense  Logistics  Agency  Regulation  (Joint  Regulation)  4155.24, 
"Product  Quality  Deficiency  Report  Program,"  July  20,  1993.  Joint 
Regulation  4155.24  only  addresses  procedures  for  handling  PQDRs  that  have 
been  prepared  on  Government-owned  items. 


Objectives 

The  objectives  of  the  audit  were  to  evaluate  the  contract  quality  assurance 
practices  on  the  contract  for  the  upgrade  of  the  optical  telescope  and  to  evaluate 
internal  controls  applicable  to  the  quality  assurance  function. 

Scope  and  Methodology 

We  reviewed  contract  procurement  documents  at  Sacramento  Air  Logistics 
Center,  McClellan  Air  Force  Base,  California,  for  the  period  from  contract 
solicitation.  May  10,  1990,  through  contract  modification  number  6, 

January  14,  1994.  We  reviewed  contract  administration  documents  at 
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DCMAO  Dallas  for  the  period  from  receipt  of  the  Category  I  PQDR, 
October  14,  1993,  through  May  20,  1994.  We  interviewed  the  SEON  Program 
Manager,  the  procurement  contracting  officer  for  the  SEON  upgrade,  the 
AFOTEC  test  director  for  the  SEON  upgrade,  and  DCMAO  Dallas  quality 
assurance  specialists  and  software  engineers.  Contract  F04606-91-C-0038  for 
the  SEON  upgrade  was  awarded  to  Electrospace  on  November?,  1990.  The 
contract  price  is  $1 1 ,068,29 1 . 

This  economy  and  efficiency  audit  was  conducted  from  March  through 
August  1994  m  accordance  with  auditing  standards  issued  by  the  Comptroller 
General  of  the  United  States  as  implemented  by  the  Inspector  General,  DoD. 
We  did  not  use  computer-processed  data  or  statistical  sampling  procedures  to 
perform  the  audit.  We  performed  the  audit  at  the  organizations  listed  in 
Enclosure  2.  No  prior  audits  covered  this  contract. 


Internal  Controls 

We  evaluated  DCMAO  Dallas  internal  controls  that  applied  to  receiving  and 
processing  PQDRs.  We  determined  that  controls  were  adequate  to  provide 
reasonable  assurance  that  assets  were  protected  against  fraud,  waste,  and  abuse. 
We  found  no  evidence  that  die  cognizant  DCMAO  Dallas  quality  assurance 
specialist  at  Electrospace  had  circumvented  internal  controls.  Theferefore  we 
did  not  review  the  implementaton  of  the  DoD  Internal  Management  Control 
Program  as  it  related  to  this  matter. 


Background 

IV^ion  of  the  Solar  Electro-Optical  Network  (SEON).  The  SEON  monitors 
solar  activity  24  hours  a  day  using  the  AN/FMQ-7  solar  observing  optical 
network  (SOON)  and  the  AN/FRR-95  radio  solar  telescope  network  (RSTN). 
The  SEON  observes  and  displays  significant  solar  events  as  they  occur  and 
provides  data  to  the  space  environmental  support  system.  The  space 
environmental  support  system  in  turn  alerts  DoD  and  other  Government 
agencies  about  these  solar  occurrences.  As  of  August  1994,  the  SEON  consists 
of  five  SOONs  and  four  RSTNs  distributed  among  six  locations  as  shown  in  the 
following  table. 
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SEON  Sites  Located  Worldwide 

Site 

Palehua,  Hawaii 

SOON,  RSTN 

Holloman  AFB,  New  Mexico 

SOON 

Sagamore  Hill,  Massachusetts 

RSTN 

Ramey,  Puerto  Rico 

SOON 

Learmonth,  Australia 

SOON,  RSTN 

San  Vito,  Italy 

SOON,  RSTN 

SEON  Upgrade  Contract.  On  November  7,  1990,  the  Air  Force  competitively 
awarded  firm-fixed-price  contract  F04606-91-C-0038  to  Electrospace.  The  goal 
of  the  contract  was  to  replace  obsolete  components  of  the  SEON  while 
upgrading  capabilities  and  improving  network  efficiency  and  the  consistency  of 
data  witl^  the  network. 

The  original  contract  specified  delivery  and  acceptance  of  the  first  SOON  and 
RSTN  for  September  30,  1992,  at  Palehua,  Hawaii.  As  of  June  6,  1994,  the 
Air  Force  had  not  accepted  the  first  SOON  and  RSTN. 

Testing  and  acceptance  is  at  a  SEON  site  because  the  solar  stimuli  necessary  for 
testing  the  upgraded  system  cannot  be  duplicated  at  the  contractor's 
manufacturing  facility  or  in  a  laboratory.  Palehua  is  the  only  U.S.  site  that  has 
both  the  SOON  and  RSTN  components  of  the  network. 

Contractor  Request  for  Equitable  Adjustment.  On  August  23,  1993, 
Electrospace  submitted  a  request  for  equitable  adjustment  to  the  Air  Force  for 
$730,918  for  claimed  program  changes  in  the  first-article  validation  process  that 
was  to  demonstrate  Electrospace's  capability  to  manufacture  an  acceptable 
product.  Asserting  that  the  Government  disrupted  the  first-article  validation 
process.  Electrospace  claimed  that  the  program  and  contract  schedule  changes 
were  caused  by  Government  delays  in  the  review  and  approval  process  of  key 
program  baselmes.  In  addition,  Electrospace  claimed  that  the  Government 
unilaterally  changed  the  application  of  a  contract  clause.  On  January  4,  1994, 
the  Government  denied  Electrospace's  request. 

Operational  Test  and  Evaluation.  Operational  test  and  evaluation  is  part  of 
the  first-article  validation  process  and  consists  of  test,  negotiation,  corrective 
action,  and  retest  phases.  AFOTEC  initiated  the  120-day  test  phase  of  the 
upgraded  system  on  September  25,  1993.  The  SOON  system  locked  up 
22  minutes  into  the  test  phase  because  of  a  software  problem,  and  the  test  was 
aborted.  AFOTEC  prepared  49  PQDRs  during  this  test. 
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AFOTEC  resumed  testing  on  February  28,  1994.  As  of  June  10,  1994, 
AFOTEC  completed  the  operational  test  phase  of  the  SEON  operational  test  and 
evaluation.  Since  operational  test  and  evaluation  testing  began  on 
September  25,  1993,  AFOTEC  prepared  a  total  of  216  PQDRs  against  the 
contract. 

PQDR  Processing.  During  the  first  test  of  the  upgraded  systems,  AFOTEC 
identified  49  deficiencies  on  the  upgraded  systems  and  issued  49  PQDRs  on  the 
SOON,  RSTN,  and  combined  SEON  systems. 

Of  the  49  PQDRs,  only  1  was  considered  significant  enough  to  be  designated  as 
a  Category  I  deficiency  in  accordance  with  Air  Force  Technical  Manual 
TO  00-35D-54,  ch^ter  4,  because  it  was  a  software  severity  level  1  deficiency. 
A  software  severity  level  1  deficiency  involves  a  system  malfunction  caused  by 
a  software  failure  that  prevents  the  accomplishment  of  a  required  operational  or 
mission-essential  capability  or  that  jeopardizes  personnel  safety. 

AFOTEC  submitted  the  initial  49  PQDRs  to  the  PQDR  screening  and  action 
points  at  Sacramento  Air  Logistics  Center.  Sacramento  Air  Logistics  Center 
reviewed  the  PQDRs  and  sent  them  to  DCMAO  Dallas  for  investigation  by  the 
cognizant  Government  quality  assurance  specialist  located  at  Electrospace. 
DCMAO  Dallas  rejected  all  49  PQDRs  because  the  contract  upgrades  had  not 
been  accepted  by  the  Government  and  thus  the  upgraded  system  was  not  a 
Government-owned  item.  DCMAO  Dallas  cited  Joint  Regulation  4155.24, 
which  states  that  reporting  product  quality  deficiencies  across  DoD  Component 
fines  applies  to  deficiencies  detected  on  [only]  new  or  reworked  Government- 
owned  products. 

Because  of  DCMAO  Dallas'  concern  with  and  the  implied  severity  of  the 
Category  I  PQDR,  DCMAO  Dallas  requested  input  from  the  contractor 
regarding  the  cause  and  remedy  for  the  condition  and  prepared  an  investigative 
report  on  the  Category  I  PQDR  using  the  contractor’s  response. 


Discussion 

Allegation.  The  complainant  alleged  that  DCMAO  Dallas  showed  favoritism  to 
the  contractor  because  of  the  manner  in  which  DCMAO  Dallas  handled  an 
investigation  of  a  PQDR.  The  complainant  stated  that  DCMAO  Dallas 
produced  an  investigative  report  on  a  Category  I  PQDR  based  only  on  the 
contractor's  version  of  the  problem,  and  that  the  report  was  full  of  erroneous 
findings. 

Audit  Response.  We  did  not  substantiate  the  allegation.  No  evidence  indicated 
that  the  DCMAO  Dallas  showed  favoritism  to  the  contractor.  Electrospace. 
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PQDR  Preparation.  Sacramento  Air  Logistics  Center  sent  a  Category  I 
PQDR  to  DCMAO  Dallas.  The  DCMAO  Dallas  quality  assurance  specialist  at 
Electrospace  then  submitted  the  PQDR  to  the  contractor  for  its  response  and 
prepared  the  investigative  report  with  only  the  contractor’s  input.  The  quality 
assurance  specialist  indicated  on  the  investigative  report  that  DCMAO  Dallas 
investigated  the  deficiaicy  with  the  contractor  and  dso  stated  that  the  PQDR 
was  not  valid  because  Ae  deficient  item  was  not  Government-owned. 

PQDR  Investigation.  The  DCMAO  Dallas  investigation  report 
contained  only  the  contractor's  opinion  as  to  the  nature,  cause,  and  remedy  for 
the  deficiency.  However,  the  nature  of  the  deficiency  was  already  known  to  the 
Air  Force  because  AFOTEC  wrote  the  PQDR  during  its  testing  of  the  system. 
Further,  the  AN/FMQ-7  upgrades  were  installed  at  the  SOON  site  in  Hawaii 
and  were  not  available  for  the  quality  assurance  specialist's  investigation. 
Therefore,  we  concluded  that  use  of  only  the  contractor’s  input  in  the 
investigation  of  the  deficiency  was  prudent  and  did  not  represent  favoritism  by 
DCMAO  Dallas. 

Factual  Content  of  the  Investigation  Report.  The  Category  I  PQDR 
investigation  report  incorrectly  stated  that  the  Government  conducted  a 
concurrent  investigation  of  the  deficiency  with  the  contractor.  The 
DCMAO  Dallas  quality  assurance  specialist  stated  that  including  a  statement  of 
concurrent  investigation  in  all  investigative  reports  was  routine  practice.  We 
discussed  this  practice  with  the  chief  of  the  Qu^ty  Assurance  Branch,  DCMAO 
Dallas,  who  then  issued  a  memorandum  to  die  branch  quality  assuran^ 
speciaUsts.  The  memorandum  cautioned  them  to  respond  clearly  and  to  state  in 
all  reports  the  functions  that  the  teams  of  quality  assurance  specialists  actually 
performed.  We  concluded  that  the  inaccurate  statement  in  the  investigative 
report  had  no  bearing  on  the  remainder  of  the  investigative  report.  We  did  not 
determine  the  accuracy  of  the  contractor's  input  into  the  investigative  rqwrt. 

Air  Force  Guidance.  The  Air  Force  guidance  was  unclear  for 
preparing  PQDRs  on  Category  I  deficiencies  and  deficiencies  discovered  on 
non-Govemment-owned  items  as  opposed  to  items  accepted  and  owned  by  the 
Government. 

Air  Force  Technical  Manual  TO  00-35D-54  provides  guidance  for  processing 
PQDRs  during  development,  acquisition,  and  test  and  evaluation.  The  technicid 
manual  was  revised  on  January  15,  1994,  and  clarifies  some  issues  that  would 
have  had  an  impact  on  the  Category  I  PQDR  that  produced  the  DoD  Hotline 
allegation.  The  revised  Air  Force  guidance  no  longer  categorizes  software 
deficiencies  differently  from  other  deficiencies.  All  Category  I  PQDRs  now 
apply  to  conditions  that,  if  uncorrected,  would  cause  death,  severe  mjury,  or 
severe  occupational  illness;  would  cause  major  loss  or  damage  to  equipment  or 
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to  a  system;  or  would  directly  restrict  combat  or  operational  readiness.  Had  this 
January  15,  1994,  revision  been  in  effect  at  the  time  of  the  testing  of  the 
system,  the  PQDR  would  probably  not  have  been  classified  Category  I. 

Clariflcation  of  the  Air  Force  Technical  Manual.  Further  clarification 
and  revision  of  the  technical  manual  is  necessary  to  explain  how  deficiencies  on 
non-Govemment-owned  items  should  be  handled.  The  Air  Force  technical 
manual  refers  to  transmitting  deficiency  reports  across  DoD  Component  lines  in 
accordance  with  Joint  Regulation  4155.24;  however,  Joint  Regulation  4155.24 
covers  deficiency  reports  only  on  Government-owned  items.  The  technical 
manual  does  not  address  procedures  for  processing  deficiency  reports  on 
non-Govemment-owned  software  and  hardware.  We  informed  Air  Force 
Materiel  Command,  which  has  overall  responsibility  for  the  technical  manual, 
of  our  concerns  regarding  the  ambiguity  and  lack  of  guidance  for  processing 
deficiencies  on  non-Govemment  owned  items.  Air  Force  Materiel  Command 
indicated  that  it  will  work  with  the  other  Military  Departments  and  the  Defense 
Logistics  Agency  to  reach  an  agreement  on  how  to  process  deficiency  reports  on 
non-Govemment-owned  software  and  hardware.  Two  Inspector  General,  DoD, 
letters  were  sent  to  the  Air  Force  Materiel  Command  voicing  our  concerns  and 
understanding  of  the  corrective  actions  that  needed  to  be  taten  (Enclosure  1). 
Because  the  Air  Force  Materiel  Command  said  that  it  would  clarify  the  technical 
manual,  we  did  not  make  any  recommendations. 


Management  Comments 

Because  this  report  contains  no  findings  and  recommendations,  written 
comments  were  not  required,  and  none  were  received. 


Courtesies  extended  to  the  audit  staff  are  appreciated.  If  you  have  questions 
about  this  audit,  please  contact  Mr.  Salvatore  D.  Guli,  Audit  Program  Director, 
at  (703)  604-9288  (DSN  664-9288)  or  Mr.  C.  J.  Richardson,  Audit  Project 
Manager,  at  (703)  604-9294  (DSN  664-9294).  The  distribution  of  this  report  is 
listed  in  Enclosure  3.  The  audit  team  members  are  listed  inside  the  back  cover. 


Robert  J.  Lieberman 
Assistant  Inspector  General 
for  Auditing 


Enclosures 
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Memorandum  About  the  Air  Force  Technical  Manual 


INSPECTOR  OENERAU 

OCPAWTMKNT  OF  DKFCNSC 
400  ARMY  NAVY  DM  VC 
ARLINGTON.  VIRGINIA  aoaoa-ao«4 


MEMORANDUM  FOR  COMMANDER,  AIR  FORCE  MATERIEL  COMMAND 

SUBJECT:  Air  Force  Technical  Manual  TO  00-35D-54,  “USAF^ 

Deficiency  Reporting  and  Investigating  System, 
January  15,  1994 


This  memorandum  is  to  inform  you  of  a 
problem  that  came  to  our  attention  during  our  audit  of  quality 
L>urane«  pr«ctic»»  for  the  AM/FMQ-7  optical  te^coopo  pr^re- 
ments  by  the  Sacramento  Air  Logistics  Center-  The 
performed  in  response  to  an  allegation  made 

Sat  pertained  to  quality  assurance  practices  by  the  Defense 
Contract  Management  Area  Operations-Dallas,  Texas.  The  allega¬ 
tion  was  not  substantiated  but  we  identified  a  problem  that  needs 
attention. 

We  determined  that  Air  Force  Technical  Manual  TO  00-35D-54 
contributed  to  confusion  and  misunderstandings  between  the 
Air  Force  and  Defense  Logistics  Agency  organizations  about 
Y'enortina  product  quality  deficiencies.  The  technical  manual 
5oerno?^di^?ingui^  between  reporting  deficiencies  on  items  that 
are  not  Government  owned  as  opposed  to  items  that  are  Government 
owned.  We  noted  this  problem  and  other  minor  discrepancies  and 
ambiguities  in  the  technical  manual  in  a  June  23,  1994  memorandum 
to  Mr.  Bruce  McKalip,  HQ  AFMC/ENPD  (enclosure).  In  ^is  reply, 

Mr.  McKalip  acJcnowledged  that  certain  sections  of  the  technical 
manual  need  to  be  clarified  or  corrected-  Mr-  McKalip  is 
identified  as  the  point  of  contact  for  working  with  the  other 
Services  and  the  Defense  Logistics  Agency  to  reach  agreement  on 
how  to  process  deficiency  reports  against  non-Government  owned 
software  and  hardware . 


would  appreciate  being  kept  informed  of  the  progress 
being  made  in  resolving  the  issue  of  reporting  deficiencies  on 
non-Government  owned  items  and  of  any  updates  or  revisions  to  the 
technical  manual.  We  will  refer  to  this  latter  in  our  draft 
audit  report  entitled  "Quality  Assurance  Practices  for  ths 
AH/FMQ-7  Optical  Telescope,"  Project  No.  4Cr-8009. 


ENCLOSURE  1 
(Page  1  of  6) 
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you  tiavu  any  quas1:lons  or  coment:8,  pXaasa  call  ma  on 
(703)  604-92«a  (DSN  664-9288)  or  Mr,  C,  J.  Richardaon,  Projact 
Nana9ar,  on  (703)  604-9294  (DSN  664-9294) . 


Contract.  Managamant  Diractorata 


ENCLOSURE  1 
(Page  2  of  6) 


1 


yiy 


INSPECTOR  GENERAL 

PKPAKTMBNT  OF  OKFBN** 
400  AOMY  MAW  OMIVB 
arunoton.  vmaiNiA  oaaoa  ioOA 


Juns  23,  1994 


hemorandum  for  porcb  kateribi.  cokhard/bhi 

SUBJECT:  Air  Fores  Tschnical  Manual  TO  00-35D-54, 

Oafielancy  Reporting  and  investigating  Syetea 

We  are  currently  doing  an  audit  in  remponee  to  e 
V..  J.ferr«d  to  th. 

«  it«  Sio?  to  i?2  Sing  occpt^l  by  tho  Air  Toro:  In 

5|AF’^»;%is^^S4rtiSrsjd  ;nv..ti,.tin, 

Systea  which  wae  re%rritten  January  15,  1994. 

The  current  aanual  ie  an  inprovenent  over  previous 

KAwavar  there  are  aabiguitiea  concerning  deficient  reporting 
however,  tt^e  ^  aaiDA^u*  ^  ^  ^  Evaluation  that  need 

?Stl.«i2i.nci.-  Bound  during 

SvSloSS”  or  i»p.r»tio"«l  T.«t  * 

and  Y-asolved  but  Question  whether  the  use  of  standard  Fone  368, 

PRODOCT  QUALITY  DEFICIBHCY  REPORT  (PQDR),  i»  th.  ^ 

dafaet.  on  itana  that  hava  not  baan  accaptad  by  tha 
daae^ba  datacr  24  indioataa  that  PQDRa  ara  for  covamnant 

iir  fSc.  ahSld  not  ua.  Standard  Form  368  to 
®^*l=^S!S;t.^iatov.r2d“u?iSg  Flrat  Articl.  Toating.  Ho  found 
SS?^u$;S®oSr  iStrSSt  S.  2a.  of  Standard  For.  3«» 

S’^2;iSaS*A5iiS2:S2iS"Si;iS!''*S.^SiiSSr«S2J2:tion. 

My  halp  to  pravant  this  problan  from  happan^  S«?*Lould^ba 
In  addition,  wa  notad  at»a  arronaoua  rafarancaa  that  ahould  ba 

changed a 


ghaptiC-Js  gEHEBAL  lyrgraiATiva 

Section  1*2  SCOPE 

Section  1*2.1  The  first  sentence  of  this 

peregreph  refers  to  Defense  Contract  Manage^nt 
Offices*^  (DCMO)  engaged  in  the  perforsance  of 
contract  adeinistration  services.  .  .  .  The 
correct  reference  should  be  to  Defense 
KanageBent  Cosmand  (DCMC)  offices  or  to  Contract 
Adeinistration  Offices  (CAO) •  A  ^fense  Contract 
'ii*iisaesent  Office  is  usually  swall  and  ie  e 
subordinate  unit  to  a  Defense  Contract  Managesent 
Area  Office  (DCMAO) . 
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SttCtion  X-8  SOFTWARE  DEriCIENCIES 

This  paragraph  indioatss  that  ■€>difiad 
dsflclsncy  raporting  procadurss  could  ba  usad  to 
corract  »lnor  software  daficianclas.  Thara  is  no 
sxplanation  as  to  what  constitutas  sodifiad 
procaduras  nor  is  thara  a  rafaranca  to  anothar 
doottsant  that  would  dascriba  aodif iad  dafieianoy 
raporting  procaduras. 

Section  1-9  CROSS  COMPONENT  REPORTlllg 

Section  1-9.1  This  paragraph  should  include 
a  statasant  that  indicates  AFX  21-115  (AFR  74-6} , 
Product  Quality  Deficiency  Report  Program, 
addrassas  only  Government  owned  items. 

Chapter^  DEFICTENCY  REPORTING  DURIMg 

TEST,  AWP  EyAWATlQir 

This  chapter  does  not  amphaaisa  the 
distinction  between  deficiency  raporting  during 
oras  on  Government  owned  and  non-Government  owned 
equipment.  It  does  not  indicate  that  only  PQDRs 
on  Government  owed  equipment  can  ba  formally 
transmitted  across  component  lines  in  accordance 
with  AFX  21-115  (AFR  74-6) ,  Product  Quality 
Deficiency  Report  Program,  nor  does  it  indicate 
how  Contract  Administration  Office  assistance  can 
ba  requested  for  the  resolution  of  deficiencies  on 
non-Government  owned  items.  Assistance  in 
resolving  deficiencies  on  items  not  owned  by  the 
Government  should  be  requested  through  normal 
communication  channels  established  between  the 
Program  Manager,  the  Procurement  Office,  and  the 
Contract  Administrative  office. 

This  chapter  should  also  indicate  that, 
if  there  are  warranties  that  can  be  invoked,  they 
are  generally  on  Government  owned  items  only.  The 
216  first  article  deficiencies  that  were  reported 
as  PQDRs  that  we  reviewed  during  the  hotline  audit 
all  erroneously  indicated  that  the  item  was  under 
warranty.  The  warranty  did  not  commence  until  the 
item  had  been  accepted  by  a  signed  DD-250.  The 
item  was  undergoing  first  article  test  and  had  not 
been  accepted. 

Section  2-4  CRIglHATING  POINT 
RESPOHSIBIHTIBS 

Section  2-4*1. 4  The  use  of  a  SF  366,  PRODUCT 
QUALITY  DEFICIENCY  REPORT,  to  report  deficiencies 
on  items  not  yet  accepted  (no  DD-2S0,  etc.)  is 
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BlvXttading.  This  form  doss  noh  hsvm  m  dots  Itsm 
to  indicsts  vhsthsr  or  not  thm  itsm  is  Govsrnmsnt 
ovnsd.  Ws  suggest  that  this  form  only  be  used  for 
Govsrnmsnt  owned  items  whether  or  not  they  cross 
component  lines;  if  there  is  doubt  ss  to  ownership 
of  the  itsm,  use  the  worksheet  ss  shown  in  figure 
2*1  of  the  Technical  Kanuel,  e  PQOR  can  be 
prepared  later  if  it  is  determined  to  be  a 
government  omed  item*  Zn  addition,  this  form 
does  not  indicate  whether  the  deficiency  is 
quality  or  design  related  (see  comments  on  para. 
2-7. 1.2,  below)  or  whether  the  deficiency  is  due 
to  contractor  error,  vague  or  inaccurate  contract 
specifications,  or  as  a  result  of  testing  to  user 
requirements  rather  than  to  contract 
specifications • 

Section  2*5  SCREEWIWCr  ■  PQIKT 
RESPPMSIBILITIES 

Section  3*5.4  This  paragraph  states  that  the 
screening  point  will  ensure  that  the  test 
director  (s)  concur  with  the  Deficiency  Reports 
prior  to  their  release.  Paragraph  2*5.1  states 
that  the  screening  point  Is  the  test  director. 

Section  3*5.5  Again,  the  note  acxionpanying 
this  paragraph  should  indicate  that  only  PQDRs  on 
Government  owned  items  should  be  transferred 
across  component  lines  in  accordance  with  AFX 
21*115.  (Also  see  Section  3*4. 4. 2) 

Section  2*7  TfcB  DEFICIENCY  REVIEW  BOARD 

Section  2*7. l.l  This  paragraph  contains  the 
statement  that  *The  SN  [Single  Manager]  should 
task  the  DPRO  to  assure  the  contractor  is 
following  the  approved  reporting  process.**  This 
reporting  process  should  apply  to  all  contractors, 
not  just  those  with  a  DPRO.  The  correct  reference 
should  be  CAO  (Contract  Administration  Office) 
rather  than  DPRO. 

Section  2*7. 1.2  This  paragraph  indicates  that 
the  TiR  DRB  [Deficiency  Review  Board]  will  rank 
order  all  open  Deficiency  Reports  unless  verified 
by  the  action  point  as  quality*related.  Quality* 
related  deficiencies  are  defined  In  Section  1*5.27 
but  there  is  no  indication  why  they  are  not  to  be 
ranked  by  the  Deficiency  Review  Board  nor  does 
this  Manual  give  any  indication  as  to  the 
significance  of  qua lity*r elated  Deficiency  Reports 
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as  opposed  to  others  (design*  etc.)*  there  is 
a  difference  in  how  each  type  is  handled*  tracked* 
investigated*  and/or  resolved  it  should  be 
indicated  in  this  Manual* 

Figure  2-3  TftE  DR  Prcctaa 

The  entry  point  (oirole)  on  the  chart 
for  "Governsent  originator  discovered  deficiency* 
contains  an  incorrect  reference.  The  correct 
reference  should  be  Paragraph- -2 . 4 *  not  2.7. 

We  would  appreciate  your  consents  on  the  above  itess  no 
later  than  July  18*  1994  so  they  can  be  incorporated  into  our 
audit  report  as  necessary.  If  we  agree  on  changes  to  the 
Technical  Manual  prior  to  issuing  the  draft  report*  there  will  be 
no  need  for  reconsendations  for  changes  to  the  Manual  and  a 
formal  response  by  the  Air  Force  to  the  draft  audit  will  not  be 
needed. 

Please  call  se  or  Mr-  Michael  Tully  at  (703)  or 

DSN  664-9294  if  you  have  any  questions  or  wish  to  discuss  the 
proposed  changes  to  the  manual.  Thank  you. 


j/y  c.J.  Richardson 
Project  Manager 
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Department  of  the  Air  Force 

Air  Force  Materiel  Command,  Wright-Patterson  Air  Force  Base,  OH 
Sacramento  Air  Logistics  Center,  McClellan  Air  Force  Base,  CA 
Detachment  1,  Air  Force  Operational  Test  and  Evaluation  Center, 
Scott  Air  Force  Base,  IL 


Defense  Organizations 

Defense  Contract  Audit  Agency,  Richardson,  TX 
Defense  Logistics  Agency,  Alexandria,  VA 

Defense  Contract  Management  Area  Operations  Dallas,  TX 
Joint  Logistics  Systems  Center,  Wright-Patterson  Air  Force  Base,  OH 


Other  Government  Organization 

Federal  Supply  Service,  General  Services  Administration,  Arlington,  VA 
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Department  of  the  Air  Force 

Secretary  of  the  Air  Force 

Assistant  Secretary  of  the  Air  Force  (Acquisition) 

Assistant  Secretary  of  the  Air  Force  (Financial  Management  and  Comptroller) 
Deputy  Chief  of  Staff  of  the  Air  Force  (Logistics) 

Commander,  Air  Force  Materiel  Command 
Commander,  Sacramento  Air  Logistics  Center 


Defense  Organizations 

Director,  Defense  Logistics  Agency 

Commander,  Defense  Contract  Management  Command 
Commander,  Defense  Contract  Management  District  South 

Commander,  Defense  Contract  Management  Area  Operations  Dallas 


Non-Defense  Federal  Organizations  and  Individuals. 


Chairman  and  Ranking  Minority  Member  of  Each  of  the  Following  Congressional 
Committees  and  Subcommittees: 

Senate  Committee  on  Appropriations 

Senate  Subcommittee  on  Defense,  Committee  on  Appropriations 
Senate  Committee  on  Armed  Services 
Senate  Committee  on  Governmental  Affairs 
House  Committee  on  Appropriations 

House  Subcommittee  oh  Defense,  Committee  on  Appropriations 
House  Committee  on  Armed  Services 
House  Committee  on  Government  Operations 

House  Subcommittee  on  Legislation  and  National  Security,  Committee  on 
Government  Operations 
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Paul  J.  Granetto 
Salvatore  D.  Guli 
C.  J.  Richardson 
Michael  J.  Tully 
Sanford  J.  Stone 
Ana  M.  Myrie 


